Assignment procedure biases in randomized policy experiments ∗
نویسندگان
چکیده
Randomized controlled trials (RCT) have become a dominant empirical tool in applied economics. The internal validity of RCTs crucially depends on the (implicit) assumption that the procedure assigning subjects to treatment and control groups has no effect on behavior. We show theoretically that this assumption is violated when people are motivated by belief-dependent preferences and care about the intentions of others. The choice of assignment procedure influences subjects’ behavior and, consequently, the RCTs’ findings. Strikingly, even a credible and explicit randomization procedure does not guarantee an unbiased prediction of the impact of a general introduction of the policy.
منابع مشابه
Reflective Practice: How the World Bank Explored Its Own Biases?
While many international organisations have independent evaluations, including the International Monetary Fund (IMF) and World Health organization (WHO), uniquely the World Bank in its 2015 World Development Report sought to ascertain the potential biases that influence how its staff interpret evidence and influence policy. Here, we describe the World Bank’s study design, including experiments ...
متن کاملAn Integrated Model for Storage Location Assignment and Storage/Retrieval Scheduling in AS/RS system
An integrated optimization framework, including location assignment under grouping class-based storage policy and schedule of dual shuttle cranes, is offered by presenting a new optimization programming model. The objective functions, which are considered at this level, are the minimization of total costs and energy consumption. Scheduling of dual shuttle cranes among specified locations, which...
متن کاملClustered Treatment Assignments and Sensitivity to Unmeasured Biases in Observational Studies
in Observational Studies Ben B. Hansen, Paul R. Rosenbaum, and Dylan S. Small1 Abstract. Clustered treatment assignment occurs when individuals are grouped into clusters prior to treatment and whole clusters, not individuals, are assigned to treatment or control. In randomized trials, clustered assignments may be required because the treatment must be applied to all children in a classroom, or ...
متن کاملCovariance Adjustment in Randomized Experiments and Observational Studies
By slightly reframing the concept of covariance adjustment in randomized experiments, a method of exact permutation inference is derived that is entirely free of distributional assumptions and uses the random assignment of treatments as the “reasoned basis for inference.” This method of exact permutation inference may be used with many forms of covariance adjustment, including robust regression...
متن کاملMitigating Evidentiary Bias in Planning and Policy-Making; Comment on “Reflective Practice: How the World Bank Explored Its Own Biases?”
The field of cognitive psychology has increasingly provided scientific insights to explore how humans are subject to unconscious sources of evidentiary bias, leading to errors that can affect judgement and decision-making. Increasingly these insights are being applied outside the realm of individual decision-making to the collective arena of policy-making as well. A recent editorial in this jou...
متن کامل